MODERATE DEVIATIONS FOR THE DURBIN- WATSON STATISTIC 
RELATED TO THE FIRST-ORDER AUTOREGRESSIVE PROCESS 



S.VALERE BITSEKI PENDA, HACENE DJELLOUT, AND FREDERIC PROIA 

Abstract. The purpose of this paper is to investigate moderate deviations for the Durbin- 
Watson statistic associated with the stable first-order autoregressive process where the 
driven noise is also given by a first-order autoregressive process. We first establish a 
moderate deviation principle for both the least squares estimator of the unknown parameter 
of the autoregressive process as well as for the serial correlation estimator associated with 
the driven noise. It enables us to provide a moderate deviation principle for the Durbin- 
Watson statistic in the easy case where the driven noise is normally distributed and in 
the more general case where the driven noise satisfies a less restrictive Chen-Ledoux type 
condition. 

AMS 2000 subject classifications: 60F10, 60G42, 62M10, 62G05. 



1. Introduction 

This paper is focused on the stable first-order autoregressive process where the driven 
noise is also given by a first-order autoregressive process. The purpose is to investigate 
moderate deviations for both the least squares estimator of the unknown parameter of the 
autoregressive process as well as for the serial correlation estimator associated with the 
driven noise. Our goal is to establish moderate deviations for the Durbin- Watson statistic 
[10J, [TT], [12], in a lagged dependent random variables framework. First of all, we shall 
assume that the driven noise is normally distributed. Then, we will extend our investigation 
to the more general framework where the driven noise satisfies a less restrictive Chen-Ledoux 
type condition [I], [16J. We are inspired by the recent paper of Bercu and Proi'a [2], where 
the almost sure convergence and the central limit theorem are established for both the least 
squares estimators and the Durbin- Watson statistic. Our results are proved via an extensive 
use of the results of Dembo [5], Dembo and Zeitouni [6] and Worms [22], [23], [21] on the 
one hand, and of the paper of Puhalskii [19] and Djellout [7] on the other hand, about 
moderate deviations for martingales. In order to introduce the Durbin- Watson statistic, we 
shall focus our attention on the first-order autoregressive process given, for all n > 1, by 

X n = 6X^ — 1 -\- En 

(1.1) 

+ v n 

where we shall assume that the unknown parameters \6\ < 1 and \p\ < 1 to ensure the 
stability of the model. In all the sequel, we also assume that (V n ) is a sequence of indepen- 
dent and identically distributed random variables with zero mean, positive variance a 2 and 
satisfying some suitable assumptions. The square-integrable initial values Xq and Eq may 
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be arbitrarily chosen. We have decided to estimate 9 by the least squares estimator 

a _ X]fc=l XkXk-i , . 

Z^fc=l ^fc-l 

Then, we also define a set of least squares residuals given, for all 1 < k < n, by 

£fc = -Xfc — 9 n X k _ 1 , (1-3) 

which leads to the estimator of p, 

Pn = g^fH (1.4) 



En 
fc=l 



fc- 



A, = ^ fc= ^Tn ^ • (1-5) 



Finally, the Durbin- Watson statistic is defined, for n > 1, as 

Z^fc=o fc fc 

This well-known statistic was introduced by the pioneer work of Durbin and Watson [10J, 
|12j . in the middle of last century, to test the presence of a significative first order serial 
correlation in the residuals of a regression analysis. A wide range of litterature is available 
on the asymptotic behavior of the Durbin- Watson statistic, frequently used in Econometry. 
While it appeared to work pretty well in the classical independent framework, Malinvaud 
[TT] and Nerlove and Wallis [TH] observed that, for linear regression models containing 
lagged dependent random variables, the Durbin- Watson statistic may be asymptotically 
biased, potentially leading to inadequate conclusions. Durbin [9] proposed alternative tests 
to prevent this misuse, such as the h-test and the t-test, then substantial contributions were 
brought by Inder [II] . King and Wu [15] and more recently Stocker [20]. Lately, a set of 
results have been established by Bercu and Proia in [2], in particular a test procedure as 
powerful as the h-test, and they will be summarized thereafter as a basis for this paper. 

The paper is organized as follows. First of all, we recall the results recently established 
by Bercu and Proia [2]. In Section 2, we propose moderate deviation principles for the 
estimators of 9 and p and for the Durbin- Watson statistic, given by (11 .2p . (jl.4p and (II. 5p . 
under the normality assumption on the driven noise. Section 3 deals with the generalization 
of the latter results under a less restrictive Chen-Ledoux type condition on (V n ). Finally, 
all technical proofs are postponed to Section 4. 

Lemma 1.1. We have the almost sure convergence of the autoregressive estimator, 
where the limiting value 

In addition, as soon as E[VJ ] < oo, we also have the asymptotic normality, 
where the asymptotic variance 

2 (l-fl 2 )(l-flp)(l-p 2 ) 

ae = OTW • (L7) 



lim 9 n = 9* a.s. 

n— >oo 



MODERATE DEVIATIONS FOR THE DURBIN- WATSON STATISTIC 3 

Lemma 1.2. We have the almost sure convergence of the serial correlation estimator, 

lim p n = p* a.s. 

where the limiting value 

p* = 9p9*. (1.8) 
Moreover, as soon as EfV^ 4 ] < oo, we have the asymptotic normality, 

V^(Pn-p*) ^A/-(0,<) 

with the asymptotic variance 

oz = l ((e + p) 2 (i + o P ) 2 + (epfa - e 2 )(i - P 2 )) . (1.9) 



2 (1 - Op) 
p (1 + o P y 



On top of that, we have the joint asymptotic normality, 

n — 0*\ £> 



A/"(o,r) 



where the covariance matrix 

Opal a 



ol Opal 



1.10) 



Lemma 1.3. We have the almost sure convergence of the Durbin-Watson statistic, 

lim D n = D* a.s. 

n— >oo 

where the limiting value 

D* = 2{l-p*). (1.11) 
In addition, as soon as E^ 4 ] < oo, we have the asymptotic normality, 

where the asymptotic variance 

a 2 D = 4a 2 p . (1.12) 
Proof. The proofs of Lemma ll.l[ Lemma 11.21 and Lemma 11.31 may be found in [2] . □ 

Our objective is to establish a set of moderate deviation principles on these estimates 
in order to get a better asymptotic precision than the central limit theorem. In all the 
sequel, (b n ) will denote a sequence of increasing positive numbers satisfying 1 = o(6 2 ) and 
b\ = o(n), that is 

? '" 0. (1.13) 



) n > OO, 



n 



Remarks and Notations. In the whole paper, for any matrix M, M' and ||M|| stand for 
the transpose and the euclidean norm of M , respectively. For any square matrix M , det(M) 
and p(M) are the determinant and the spectral radius of M, respectively. Moreover, we will 
shorten large deviation principle by LDP. In addition, for a sequence of random variables 
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(Z n ) n on R dxp , we say that (Z n ) n converges (b^—superexponentially fast in probability to 
some random variable Z if, for all 5 > 0, 



lim sup — log P ( \\Z n — Z\\ > 8 

n— ¥oo 0„ V 



— oo. 



This exponential convergence with speed b 2 n will be shortened as 



„ supercxp „ 
Z n > Z. 

b 2 



The exponential equivalence with speed b\ between two sequences of random variables (Y n ) n 
and (Z n ) n , whose precise definition is given in Definition 4-2.10 of [6], will be shortened as 



... superexp 

y n ~ z n . 

b 2 



2. On moderate deviations under the Gaussian condition 



In this first part, we focus our attention on moderate deviations for the Durbin- Watson 
statistic in the easy case where the driven noise (V n ) is normally distributed. This restrictive 
assumption allows us to reduce the set of hypothesis to the existence of t > such that 

(G.l) 



(G.2) 



E 



E 



exp(teo) 



exp(tX, 



< oo, 



< oo. 



Theorem 2.1. Assume that there exists t > such that (Gfl]) and (GJ2]) are satisfied. 
Then, the sequence 



6„ — 9* 



n>l 



satisfies an LDP on R with speed b 2 n and good rate function 

h(x) 



X 



2CT 



(2.1) 



where aj is given by (11.71) . 

Theorem 2.2. Assume that there exists t > such that (Gfl]) and (GJ2]) are satisfied. 
Then, as soon as 9 ^ —p, the sequence 

Vn (9 n - 9* 

b n \Pn - P* 



n>l 



satisfies an LDP on R 2 with speed b\ and good rate function 



K{x) 



-x'T^x 
2 

where V is given by fll.lOp . In particular, the sequence 



(2.2) 
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satisfies an LDP on R with speed b n and good rate function 



W*) = ^ (2-3) 

where a 2 is given by (11.91) . 

Remark 2.1. The covariance matrix T is invertible if and only if 9 ^ — p since one can 
see by a straightforward calculation that 

det{) ~ (1 + p 2 ) 
Moreover, in the particular case where 9 = —p, the sequences 



and (^(Pn-P* 

satisfy LDP on R with speed b 2 n and good rate functions respectively given by 

x 2 {l-9 2 ) x 2 (l-9 2 ) 
Iff(x) = — ; —— and l n (x) 



2(1 + 9 2 ) py ' 29 A {\ + 9 2 ) 

Theorem 2.3. Assume that there exists t > such that (GJT]) and (GJ2]) are satisfied. 
Then, the sequence 



Or, V ' / ^i 

n / n>l 



satisfies an LDP on R with speed b 2 n and good rate function 



x 2 



Id{x) = (2.4) 
where o~ 2 D is given by (I1.12p . 

Proof. Theorem 12. 1[ Theorem 12.21 and Theorem 12.31 are proved in Section 4. □ 

3. ON MODERATE DEVIATIONS UNDER THE CHEN-LEDOUX TYPE CONDITION 

Via an extensive use of Puhalskii's result, we will now focus our attention on the more 
general framework where the driven noise (V n ) is assumed to satisfy the Chen-Ledoux type 
condition. Accordingly, one shall introduce the following hypothesis, for a = 2 and a = 4. 

(CL.l) Chen-Ledoux. 



limsup — lognPf|Vi| a > b n \fn 

(CL.2) 



— oo. 



I c o I s uperex p 



(CL.3) 

XI a 
1 s uperex p 

bnVn bl 



0. 
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Remark 3.1. If the random variable V\ satisfies (CLJTJ with a = 2, then 



lim sup — ■ log nF( I Vl - E[lf ] \ > b n ^/n) = -oo, 



(3.1] 



which implies in 'particular that Var(V 1 4 ) < oo. Moreover, if the random variable V\ has 
exponential moments, i.e. if there exists t > such that 



E 



exp (tV? 



< oo, 



then (CL.[TJ) is satisfied for every increasing sequence (&„). From pQ, [13], condition ( 13.11) 
is equivalent to say that the sequence 



n>l 



satisfies an LDP on R with speed b 2 n and good rate function 

= 2Var(^ 2 )" 

Remark 3.2. // we choose b n = n a with < a < 1/2, (CLJTJ is immediately satisfied if 
there exists t > and < (3 < 1 such that 



E 



exp (tV{ 



< oo, 



which is clearly a weaker assumption than the existence oft>0 such that 

E exp (rtf ) < oo, 

imposed in the previous section. 

Remark 3.3. // (CHTJ) is satisfied for a = 4, then it is also satisfied for all < b < a. 

Remark 3.4. In the technical proofs that will follow, rather than (CHTJ) with a = 4, the 
weakest assumption really needed could be summarized by the existence of a large constant 
C such that 



limsupilogp(iX> 4 >c) 



-oo. 



Theorem 3.1. Assume that (CLJT]), (CL]2]) and (CL]3]) are satisfied. Then, the sequence 



-7— I n - 9* 

b n 



satisfies the LDP on R given in Theorem \2.1[ 

Theorem 3.2. Assume that (CL.[TJ), (CL]2]) and (CL]3]) are satisfied. Then, as soon as 
9 ^ —p, the sequence 

(9 n - 9* 
b n VPn-P*// n >i 
satisfies the LDP on R 2 given in Theorem \2.2\ In particular, the sequence 
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satisfies the LDP on R also given in Theorem \2.2\ 

Remark 3.5. We have already seen in Remark \2. II that the covariance matrix F is invertible 
if and only if 9 ^ —p. In the particular case where 9 = —p, the sequences 



™d (^(Pn-P* 
satisfy the LDP on R given in Remark \2.1i 

Theorem 3.3. Assume that (CL.[TJ), (CLJ2]) and (CLJ3]) are satisfied. Then, the sequence 
satisfies the LDP on R groen m Theorem \2.3[ 

Proof. Theorem 13. 1[ Theorem 13.21 and Theorem 13.31 are proved in Section 4. □ 

4. Proof of the main results 

For a matter of readability, some notations commonly used in the following proofs have 
to be introduced. First, for all n > 1, let 



k=l 



Then, let us define M n , for all n > 1, as 



M n = Y J *k-iV k (4.2) 



k=l 



where M = 0. For all n > 1, denote by J-" n the a- algebra of the events occurring up to 
time n, T n = a(X ,e , Vi, ■ • • , V n ). We infer from f )4.2p that (M n ) n > is a locally square- 
integrable real martingale with respect to the filtration F = (J-" n ) n > with predictable qua- 
dratic variation given by (M) = and for all n > 1, (M) n = a 2 S n - U where 



4 = E4 ( 4 - 3 ) 

fc=0 

Moreover, (iV n ) n > is defined, for all n > 2, as 

n 

N n = Y,Xk-2V k (4.4) 



k=2 



and N = Ni = 0. It is not hard to see that (iV" n ) n > is also a locally square-integrable 
real martingale sharing the same properties than (M n ) n >o- More precisely, its predictable 
quadratic variation is given by (N) n = cr 2 S , n _ 2 - To conclude, let P = and, for all n > 1, 

n 

P n = Y,Xk-iX k . (4.5) 

k=l 
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4.1. Proof of Theorem [2H1 

Before starting the proof of Theorem 12. 11 we need to introduce some technical tools. Denote 
by I the almost sure limit of S n /n [2J, given by 

,= t^±M (46) 

Lemma 4.1. Under the assumptions of Theorem \2.1\ we have the exponential convergence 

Sn superexp ,^ . 

n bi 



where i is given by (14.61) . 

Proof. After straightforward calculations, we get that for all n > 2, 



n 



a 1 



n J n n n 



(4i 



where L n , M n , S n and N n are respectively given by f H~Tj) . P~2]) . (I4~3j) and (jOJ), 

i? n = [2(0 + p)p* - (6 + pf - (6p) 2 ]X 2 n - {OpfXl^ + 2p*X n X n _ 1 + 
and where the remainder term 

a = (1 - 2#p - p 2 )X 2 + p 2 e 2 + 26pX E - 2pp*(e - X )X + 2p(e - X Q )V X . 

First of all, (V n ) is a sequence of independent and identically distributed gaussian ran- 
dom variables with zero mean and variance a 2 > 0. It immediately follows from Cramer- 
Chernoff's Theorem, expounded e.g. in [6], that for all 5 > 0, 



lim sup — log P 



n 



a 



>5 < 0. 



Since b 2 n = o(n), the latter convergence leads to 



-LJ-n superexp 2 

n bl 



(4.9) 



(4.10) 



ensuring the exponential convergence of L n /n to a 2 with speed b 2 n . Moreover, for all 5 > 
and a suitable t > 0, we clearly obtain from Markov's inequality that 



> 5 J < exp (-tn<J)E exp(*X 2 



which immediately implies via (GJ2]), 



Y 2 

o superexp 



n 



b- 



0. 



(4.11) 



and we get the exponential convergence of Xfi/n to with speed b 2 n . The same is true 
for V 2 /n, e\jn and more generally for any isolated term of order 2 in relation (14. 8 j) whose 
numerator do not depend on n. Let us now focus our attention on X 2 /n. The model (II. ip 
can be rewritten in the vectorial form, 



(4.12) 
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where $ n = (X n X n -i) stands for the lag vector of order 2, W n = (V n 0)' and 



.4 



9 + p 
1 







(4.13) 



It is easy to show that p(A) = max(|0|, \p\) < 1 under the stability conditions. According 
to Proposition 4.1 of |22j . 



1$, 112 



n 1 1 supcrcxp 



0. 



n 



which is clearly sufficient to deduce that 



Y 2 
n superexp 

n bi 



0. 



(4.14) 



The exponential convergence of R n /n to with speed b 2 n is achieved following exactly the 
same lines. To conclude the proof of Lemma 14.1} it remains to study the exponential 
asymptotic behavior of M n /n. For all 5 > and a suitable y > 0, 



P 



n 



> 5 



P 



(M n 



\ n 



> 5, (M) n < y ) + W>(— > 6, (M) n > y 



\ n 



< exp 



n 2 5 2 

2y 



+ ¥>((M) n >y 



(4.15) 



by application of Theorem 4.1 of [3] in the case of a gaussian martingale. Then, noting that 
we have the following inequality, 

S n < aXl + /3el + (5L n a.s. 



(4.16) 



with a = 1 + (1 - |0|) 2 and (5 = (1 - \p\) z (1 - \6\) \ we get for a suitable t > 



-2 



v-2 



> 



3(3o< 



< 



6XP [jiacr 2 ) E exp ^o) +exp 

2/ 



y 



3f3o 2 



E 



3/3<r 2 
exp(teo) 



< 3 max ( exp 



-yt 



3aa 2 



E 



exp(tX 2 ] 



exp 



-yt 



3/3a 2 



E 



exp(te 2 ) 



P L„-i > 



3/3a 2 



Let us choose y = nx, assuming x > 3/3cr 4 . It follows that 



L logP((M) n > nx) < ^|^ + imax 



b 2 b 2 

n n 

—nxt 



-nxt 



3aa 2 



+ logE 



3(3a 2 



+ logE 



exp(te 2 



exp(tXg 



logP L n _i > 



nx 



313a 2 



Since b 2 n = o(n) and by virtue of (I4.10p with 6 — xj (3/3<t 2 ) — o 2 > 0, we obtain that 



limsup — logP('(M) n > nx 



-OO. 



(4.17) 
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It enables us by ( I4.15P to deduce that for all 5 > 0, 

limsup-^logP ( — > S) = -oo. (4.18) 

The same result is also true replacing M n by —M n in (14.181) since M n and — M n share the 
same distribution. Therefore, we find that 



Ln superexp 



n 



0. 



(4.19) 



A similar reasoning leads to the exponential convergence of N n /n to 0, with speed b 2 n . 
Finally, we obtain flUZD from (H3J) together with ffODjl . (j4TTT|) . ( Olj) and flggp which 
achieves the proof of Lemma 14. 1[ □ 



Corollary 4.2. By virtue of Lemma 1^.1 and under the same assumptions, we have the 
exponential convergence 

P n superexp n ^ ,^ ^g^ 



n bl 



where l x = 9*1. 

Proof. The proof of Corollary 14.21 is immediately derived from the following inequality, 

L R n (9) 



P 9 

n n 



< 



' n 

\M n 



+ 



1 + 



n 

\Rn(e)\ 



x 2 

q* n 

n 



+ \e* 



Xi 



(4 21) 

1 + Op n 1 + 9p n 1 n 

with = OpXnXn-i + pX (e -X ). □ 

We are now in the position to prove Theorem 12 . 11 We shall make use of the following 
deviation principle for martingales established by Worms |21j . 

Theorem 4.3 (Worms). Let (Y n ) be an adapted sequence with values in W, and (V n ) a 
gaussian noise with variance a 2 > 0. We suppose that (Y n ) satisfies, for some invertible 
square matrix C of order p and a speed sequence (6^) such that b 2 n = o{n), the exponential 
convergence for any 5 > 0, 

n— 1 



lim — log P 

n— Yoo 



Then, the sequence 



k=0 



> 5 



-oo. 



(4.22) 



n>l 



satisfies an LDP on M. p of speed b 2 n and good rate function 



I{x) 

where (M n ) is the martingale given by 



2a 2 



x'C l x 



(4.23) 



k=l 



Proof. The proof of Theorem 14. 31 is contained in the one of Theorem 5 of [21] with d 



□ 
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Proof of Theorem 12.11 Let us consider the decomposition 



b n 



e n - e* 



'n I a 
b n VI + 



Rn(9) 

(M) n ' b n \l + 6 P ) S n _l ' 



M„ . v/ " 



(4.24) 



that can be obtained by a straighforward calculation, where the remainder term R n (6) is 
defined in (I4.2ip . First, by using the same methodology as in convergence (14. lip , we obtain 
that for all 5 > and for a suitable t > 0, 



X 2 



b n Jn 



limsup — logP ( — ±= > 5) < lim ( -t5^— ) + lim — logE exp(tX 2 



1 



n— >oo ?) 2 

n 



-OO, 



(4.25) 

since 6 n = o(y / n), and the same goes for any isolated term in (I4.24p of order 2 whose 
numerator do not depend on n. Moreover, under the gaussian assumption on the driven 
noise (V n ), it is not hard to see that 

I , r2 superexp n (4 26) 



^_ max Vi 

b n \/nl<k<n bl 



0. 



As a matter of fact, for all 5 > and for all t > 0, 



' \fe=l / fc=l 



< nexp (-t6b n y/n)E\ exp (tlf) . 
In addition, as soon as < t < l/(2a 2 ), E[exp(tV / 1 2 )] < oo. Consequently, 



— log P ( max V£ > 6b n y/n\ < 

bl V<^<n J 



\ogn _tS^i logE^exp^ 2 
~bl bT + hi 



< 



y/n I logn 



J n \ u n 



b n \fn 



t5 + 



logE 



exp (tV? 



b n Jn 



which clearly leads to (14.26)) . Furthermore, it follows from (II. ip that 

2 



max X, < — 

l<k<n 1 



as well as 



max £ h < 

Kk<n 



1- IP 



4 + 



i 



i 



max e 

Kk<n 



max K 2 . 



1 — \p\J l<k<n 



Then, we deduce from fl4T25l) . f)4T26]) . K27h and K28h that 



- — = max e h — 

b n ^/n l<k<n bl 



2 superexp 



and 



1 V 2 superexp 

= max X k — > 0, 

b n Jni<k<n bl 



(4.27) 



(4.28) 



which of course imply the exponential convergence of X 2 /(6 n y / n) to 0, with speed b 2 n . 



Therefore, we obtain that 



Rn(9) 



superexp 



bnVn bl 



0. 



(4.29) 



12 S.VALERE BITSEKI PENDA, HACENE DJELLOUT, AND FREDERIC PROIA 

We infer from Lemma [4.11 together with Lemma 4.1 of [22] that the following convergence 
is satisfied, 

n sup^exp I (43Q) 

where £ > is given by ( 14. 6 h . According to 04.29p , the latter convergence and again Lemma 
4.1 of [22], we deduce that 



yfn ( 1 \ R n {9) supcrcxp 



b n \l + 9pj S n -! b\ 
Hence, we obtain from (14 .301) that the same is true for 

a 2 M„ ( n 1 



0. (4.31] 



supcrcxp ^ ^ 



l + 9pb n ^i\(M) n aHJ hi 

since Lemma 14.11 together with Theorem 14.31 with p — 1 directly show that (M n /(b n \fn)) 
satisfies an LDP with speed b\ and good rate function given, for all x G 1, by 



Tl /c supcrcxp 1 -^n 



As a consequence, 

and this implies that both of them share the same LDP, see e.g. [6]. One shall now take 
advantage of the contraction principle [6] to establish that (y/n(9 n — 9*)/b n ) satisfies an 
LDP with speed b\ and good rate function 1q{x) given by (12. lj) . The contraction principle 
enables us to conclude that the good rate function of the LDP with speed b 2 n associated 
with equivalence (I4.34p is given by Iq{x) = J(£(l + 9p)x), that is 

Io(x) 



2af 

which achieves the proof of Theorem 12.11 □ 

4.2. Proof of Theorem E21 

We need to introduce some more notations. For all n > 2, let 

« 

Q n = Y, X k-2V k . (4.35) 

fc=2 

In addition, for all n > 1, denote 

where S n and P n are respectively given by ( 14.31) and ( 14. 51) . Finally, for all n > 0, let 



T n = 1 + 9*p* - (l + p*(9 n + 9*)) -p- + (V +9 n + 9*)^- (4.36) 



J„. = $> fc 2 (4.37) 

fe=0 

where the residual set (e n ) is given in (II. 3p . A set of additional technical tools has to be 
expounded to make the proof of Theorem 12.21 more tractable. 
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Corollary 4.4. By virtue of Lemma 1^.1 and under the same assumptions, we have the 
exponential convergence 

Qn superexp „ 



n bl 



where i 2 = ((9 + p)9* - 9p)l. 

Proof. The proof of Corollary 14.41 immediately follows from the inequality, 



n n 



M N £ Q 

q* lvl n iv n _|_ Sn 

n n n 



< \e* 



\M„ 



n 



+ 



\N„ 



n 



+ 



71 



(4.38) 



where £® is a residual made of isolated terms such that 

£n su perex p 

n bl 

see e.g. the proof of Theorem 3.2 in [2] where more details are given on □ 
Lemma 4.5. Under the assumptions of Theorem \2.2[ we have the exponential convergence 



A, 



superexp 
b 2 



A 



where 



A, 



n 







and 



A 



fj_ 

S n ~\ 
T n (6 + p) 

\Jn—l Jn—1 I 

1 - 



£(l + 9p)(l-(9*) 2 ) 



+ 



*) 2 

□ *\2 



(0 + P) 

Proof. Via (I4.30p . we directly obtain the exponential convergence, 



n 



superexp 



(4.39) 



(4.40) 



(4.41) 



(i + P )<Vi K e(i + e P y 

The combination of Lemma [4. 1[ Corollary 14 .2\ Corollary 14.41 and Lemma 4.1 of [22] shows, 
after a simple calculation, that 



T 



superexp ,„„,2 



b 2 



r + op. 



(4.42) 



Moreover, J n given by (14.371) can be rewritten as 

Jn = S n — 29 n P n + 9 n S n —i, 
which leads, via Lemma 4.1 in [22], to 



J, 



n superexp 



n b 2 

Convergences (14.421) and (14.431) imply 



n 



T 



superexp 



(9*) 2 + 9p 



l + 9pj J n _L bi £(i + 9p)(l-(9*y) 



(4.43) 



(4.44) 
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and finally, 

n \ 9 + p superexp 9 + p ,^ . 



l + 9p) J n _! bi £(i + 9p)(l-(9*) 2 ) 
Finally, (I4.4ip together with f l4.44f) and ( 14. 45ft achieve the proof of Lemma 14.51 □ 

Proof of Theorem 12.21 We shall make use of the decomposition 

v 7 ™ (9 n - 6*\ _ _ 1 



... 1 ^A n Z n + B n , (4.46) 
where A n is given by ( I4.39p . (Z n ) n > is the 2-dimensional vector martingale given by 

Z. = g) , (4.47) 

and where the remainder term 

/ Rn(0) \ 
S n -l 



Rn{p) 



(4.48) 



(l + 9 P ) b n 

V J n -t ) 

The first component R n {9) is given in (I4.2ip while R n (p), whose definition may be found in 
the proof of Theorem 3.2 in [2], is made of isolated terms. Consequently, ( 14.251) and (14.291) 
are sufficient to ensure that 

R n (9) superexp . R n (p) superexp 

- — 1= — > and - — -j= — > 0. 

b n \/n bl b n Jn bl 



Therefore, we obtain that 

B n SU ^T P 0. (4.49) 

In addition, it follows from Lemma 14.51 and Theorem 14.31 with p = 2 that (Z n /(b n y/n)) 
satisfies an LDP on R 2 with speed b 2 n and good rate function given, for all x 6 R 2 , by 

J( x ) = -Lx'A^x, (4.50) 
2a 2 

where 

'1 9 



A = £ ( \ ), (4.51) 



since we have the exponential convergence 

\Z/n superexp 2 



n bl 



a 2 A (4.52) 



by application of Lemma HJ] and Corollary 14.21 One observes that det(A) = £ 2 (l — (9*) 2 ) > 
implying that A is invertible. As a consequence, 

1 / . . \ r — . superexp 



7 / V / 't 

bnV n b l 

and we deduce from (I4.46[) that 

( 9 n — 9*\ superexp 1 



(A n -A)Z n *^0, (4.53) 



bn \Pn - P*J bl b n y/fi 



AZ n . (4.54) 
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This of course implies that both of them share the same LDP. The contraction principle [6] 
enables us to conclude that the rate function of the LDP on IR 2 with speed b 2 n associated 
with equivalence (14.541) is given, for all x G IR 2 , by K(x) = J(A x), that is 

K{x) = ^x'F^x, 

where T = a 2 AAA' is given by (ll.lOp . and where we shall suppose that 9 ^ —p to ensure 
that A is invertible. In particular, the latter result also implies that the good rate function 
of the LDP on IR with speed b 2 n associated with (y/n(p n — p*)/b n ) is given, for all x G IR, by 

I p (x) 



where a 2 is the last element of the matrix T. This achieves the proof of Theorem I2.2L □ 



4.3. Proof of Theorem O 

For all n > 1, denote by /„ the explosion coefficient associated with J n given by (14 .3 7ft . 



that is 



/„ = Jn = %■ (4-55) 



It follows from decomposition (C.4) in [2] that 



where the remainder term ( n is made of isolated terms. As before, we clearly have 



superexp , „ superexp 

1— Cn — » and /„ — + 0. 

&n bl bl 



As a consequence, 



Tl ( c; superexp 



? v D n - D*J -2^ ( p n - p* ) , (4.57) 



and this implies that both of them share the same LDP. The contraction principle [6] 
enables us to conclude that the rate function of the LDP on IR with speed b 2 n associated 
with equivalence (I4.57P is given, for all x G IR, by Id{%) = -fp( —a; /2), that is 

„2 



Id(x) ' 



2oy 



which achieves the proof of Theorem 12.31 □ 



4.4. Proofs of Theorem 13. 1L Theorem 13.21 and Theorem 13.31 

We shall now propose a technical lemma ensuring that all results already proved under 
the gaussian assumption still hold under the Chen-Ledoux type condition. 

Lemma 4.6. Under (CLJTJ), (CLJ2]) and (CLJ3J), all exponential convergences of Lemma 
4-l\ Corollary Corollary \4-4\ and Lemma \4 . 5\ still hold. 
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Proof. Under (CLJT]), (CLJ2]) and (CLJ3]), and following the same methodology as the 
one used to establish (14.291) . we get 



Y 2 

n supcrcxp 



, r- 0, (4.58) 

and Cauchy-Schwarz inequality implies that this is also the case for any isolated term of 
order 2, such as X n X n _i/ (b n y/n). This allows us to control each remainder term. Note that 
(CLJ2D, (CLJ3D and (I4.58P are obviously true for Eq/h, Xq/ti, ejj/n, Xq/ti and X%/n, since 
b n \fn = o(n). Moreover, if follows from Theorem 2.2 of [13] under (CL{T]) with a = 2, that 

^"To 3 . (4.59) 

n bl 

Furthermore, since (M n ) is a locally square integrable martingale, we infer from Theorem 
2.1 of [3J that for all x,y > 0, 

p(|M n | > x, (M) n + [M] n <y)< 2exp (~7^) , ( 4 -60) 

where the predictable quadratic variation (M) n = a 2 S n -i is described in (14. 3 ft and the total 
quadratic variation is given by [M]q = and, for all n > 1, by 

n 

[M] n = Y,X 2 k -iVl (4.61) 

fc=i 

According to (14.601) . we have for all 5 > and a suitable b > 0, 



P 



n 



>b^j < P(|M n | > 5n, (M) n + [M] n < nb^j + p((M)„ + [M] n > nb 

< 2exp(-^\ +p((M> n + [M] n >n&), 

< 2max (p((M) n + [M] n > nfe),2exp 



Consequently, 



limsup-^logP ( > cH < limsup-^logP((M) n + [M] n > nfcY (4.62) 



We have for all b > 0, 

p((M) n + [M] n >nfc) < P^(M) n >yj+P^[M] n >^j, 

< 2max^(M) n >^,P^[M] n >y^. (4.63) 
Moreover, for all n > 1, let us define 

n n 

T n = Y,K and r„ = ^V fc 4 , 

k=0 k=l 

and note that we easily have the following inequality, 

T n < al 4 + Pel + (3T n a.s. (4.64) 
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with a = 1 + (1 — \0\)~ 4 and — (1 — |p|) _4 (l — l^l) -4 . This implies that, for n large 
enough, one can find 7 > such that 

T n < ^T n a.s. 

choosing for example 7 = 3max(a,/3), under (CLJ2]) and (CLJ3]) for a = 4. According to 
Theorem 2.2 of [13] under (CLfJJ) with a = 4, we also have the exponential convergence, 

r„ superexp 4 , . , 
)• T , 4.65 

where r 4 = E[Vj 4 ], leading, via Cauchy-Schwarz inequality and (I4.64p . to 
lim sup —r log P (- — — > S ) < lim sup — log P ( — > 

= -00, (4.66) 

where 5 > t 4 Ai /t". Exploiting (I4.16P and (I4.59p . the same result can be achieved for (M) n /n 
under (CLfTJ) with a = 2 and 6 > a 4r y. As a consequence, it follows from f)4.63p . f)4.66p 
and the latter remark that 

limsupllogpf <M) ": [M| ">^=-oc, (4.67) 



n— >oo 
.4 



11 



as soon as b > a 7 + r\^y. Therefore, the exponential convergence of M n /n to with 
speed b\ is obtained via (I4.62p and ( I4.67p . that is, for all 5 > and 6 > <r 4 7 + t 4 ^, 

lim sup ^ log P ( > 5 ) = -00. (4.68) 

The same obviously holds for N n /n. Following the same lines as in the proofs of Lemma l4TTj 
Corollary 14.2^ Corollary 14.41 and Lemma 14.51 hypothesis (CLJ2]) and (CLJ3]) with a = 4 
together with exponential convergences f)4.58p . (I4.59P and (I4.68P are sufficient to achieve 
the proof of Lemma 14.61 □ 

Let us introduce a simplified version of Puhalskii's result [19] applied to a sequence of 
martingale differences, and two technical lemmas that shall help us to prove our results. 

Theorem 4.7 (Puhalskii). Let (^i")i<j<n be a triangular array of martingale differences 
with values in M. d , with respect to the filtration (J r n )n>i- Let (b n ) be a sequence of real num- 
bers satisfying (I1.13p . Suppose that there exists a symmetric positive-semidefinite matrix Q 
such that 

Suppose that there exists a constant c > such that, for each 1 < k < n, 

\ml\ < c^ a.s. (4.70) 
Suppose also that, for all a > 0, we have the exponential Lindeberg's condition 
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Then, the sequence 



n 

— T 



ml 



i. r~ / j " k 
o n Jn ' 



fc=i / n>\ 

satisfies an LDP on M. d with speed b 2 n and good rate function 

A*(v) = sup f X'v- -A'QAj . 



In particular, if Q is invertible, 

h*{v) = ^v'Q^v. (4.72) 

Proof. The proof of Theorem 14.71 is contained e.g. in the proof of Theorem 3.1 in [19]. □ 
Lemma 4.8. Under (CLfl]), (CLfJ) and (CLJ3]) with a = 2, we have for all S > 0, 

lim sup lim sup — log P I — Xll{\x k \>R} > S J < 0. 

R— >oo n— >oo W> \ fl J 

Remark 4.1. Lemma \478\ implies that the exponential Lindeberg's condition given by (14.711) 
is satisfied. 

Proof. We introduce the empirical measure associated with the geometric ergodic Markov 
chain (X n ) n > , 



A 



1 



n 

k=l 



with invariant probability measure denoted by fi. It is well-known that the sequence (A n ) 
satisfies the upper bound of the moderate deviations, see e.g. (8] for more details. Let us 
define, for f(x) = x 2 , the following truncations, 

f( R )( x ) =/(x)min(l, and f {R) {x) = min (f {R) (x), i?) . 

Thus, we have 

< f(x)I {fix) > R} < f {R) (x) < f(x), 

and, as a consequence, 

< An (fl {f > R} ) < An(f {R) - ]*«>) + An(f iR) ) - »(f iK >) + »(f iR) ). 

We also have 

f {R) - f {R) = (f {R) - R)i {f w> R} <(f- R)kf>R} = f - (f a 4 

For 5 > 0, the functions f^ and / — (/ A R) are continuous and bounded by / which is 
/x-integrable, and they converge to as R goes to infinity. By Lebesgue's Theorem, there 
exists R > large enough such that fi(f^) + fx(f — (/ A R)) < S /4. Thus, 

P (^E X *Vi?>^>^ < P(A n (/)- A1 (/)>(J/4)+p(A n (/A J R)-/i(/A J R)>(J/4) 

+ p(A n (/^)-M/ (i?) )> V4). (4.74) 
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-oo. 



From Lemma 14. 6[ we have that for all 5 > 0, 

limsup-^logP(A n (/) -Kf)> & 

By the upper bound of the moderate deviation principle for the sequence (A ra ) given in [8], 
we obtain that 

limsuplimsup ^ logP^A„(/ A R) - A R) > s) — -oo, 

R— too 

and 

limsuplimsup-^logP(A n (/ (R) ) - (i{f (R) ) > s) = -oo, 

which, via inequality (14. 74ft . achieves the proof of Lemma 14.81 Note that Remark 14.11 is 
immediately derived from the latter proof, see e.g. [22] for more details. □ 



Lemma 4.9. Under (CLJT]), (CLJ2]) and (CLJ3]), the sequence 



satisfies an LDP on R with speed h 2 n and good rate function 



A*) = ^5 (4-75) 



where £ is given by (14. 6 j) . 



Proof. From now on, in order to apply Puhalskii's result for the moderate deviations for 
martingales, we introduce the following modification of the martingale (M n ) n >o, for r > 
and R > 0, 

n 



k=l 



where, for all 1 < k < n, 



xi r) =X k h ^ and v£ R) =\j.[ ( .. i -3 



(4.77) 



L r , , a: ~i ana v h ■ ' = Kfci r , 1 — iel 141 r , 1 

{|X fc |<r^} fc {|V fe |<ij} L |l^l<«}. 

Then, we have to prove that for all r > the sequence is an exponentially good 

approximation of (M n ) as R goes to infinity, see e.g. Definition 4.2.14 in [6]. This approxi- 
mation, in the sense of the large deviations, is described by the following convergence, for 
all r > and all 5 > 0, 

1 / \M n — Mn ,R ^ I 

lim sup lim sup — log P — — — > 5 I = — oo. (4.78) 



From Lemma [4.61 and since (M) n = a S n -i, we have 

a 2 £. (4.79) 



(M) 

n supcrexp 2, 



n hi 

From Lemma [4.61 and Remark 14. 1[ we also have for all r > 0, 



-Vl t 2 Ir |x|> ^ SU ^T P 0. (4.80) 
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We introduce the following notations, 



4 = E 



and SW = 



k J ■ 



k=0 



Then, we easily transfer properties ( I4.79P and (I4.80p to the truncated martingale (Mn' R ^) n >o- 



We have for all R > and all r > 0, 



a 



n 



R~ 



-a 



a c( r ) 

Jn-l °n-l 



n 



R 



S n -1 



superexp 2 



n 



n 



R~ 



which ensures that ( 14. 69ft is satisfied for the martingale (Mn )n>o- Note also that Lemma 
14.61 and Remark 14 . 1 1 work for the martinagle (M| r,fl ')„>o. So, for all r > 0, the exponential 
Lindeberg's condition and thus (I4.7ip are satisfied for (M« ) n >o- By Theorem 14. 7\ we 
deduce that {Mn ,R) /b n y/n) satisfies an LDP on R with speed b 2 n and good rate function 

.,2 



n bi 



a 



J R (x) 



X 



2a 2 R f 



(4.81) 



It will be possible to drive the moderate deviations result for the martingale (M n ) n > by 
proving relation ( 14 .78 p . For that matter, let us now introduce the following decomposition, 



n ' n 



where 



n n 

4° 14 and F^ = ^{v k 'Vt R) )xtl r 

k=l k=l 



One has to show that for all r > 0, 



i-'n superexp 



and, for all r > and all 5 > 0, that 



b n \/n bl 



1 



(4.82) 



<r,R) | 



lim sup lim sup — log P 

R—>oo 



b ny /n 



> 5 



-oo. 



(4.83) 



On the one hand, note that for any rj > 0, 

n n 

£ \X k \ 2+ " < a\X \^> + P\e \ 2+ v + \V k \ 2+v a.s. 



k=0 



k=l 



with a = 1 + (1 - \9\)-( 2+ ^ and p = (1 - \p\)- {2+7l) (l - \6\)- { - 2+ ^ . This implies that, for n 
large enough, one can find 7 > such that 



£ 1* 



1 2+77 



k=0 



<iJ2\ Vk 

k=l 



2+77 



a.s. 



(4.84) 
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taking for example 7 = 3max(a,/3), under (CLJ2]) and (CLJ3]) for a = 2 + 77. Thus, 



\L 



Mi 



h n \fn b n \/n 



b n y/n \ b 
< A(r,r/,7) 



E x ^ l { lXk _ 1>r g} v > 

n 
k=l 



— r; / n 



1/2 



fe-i 



k=l 



(4.85) 



by virtue of f)4.84p and Holder's inequality, where A(r, 77,7) > can be evaluated under 
suitable assumptions of moment on (V n ). As a consequence, for all 5 > 0, 



lim 



1 / l/~ (r) l \ 1 / 1 n 

SU p-logPN-^>5 < limsup-logP \-Y^\V k \ 2+r < > 



5 



X(r,r},j) V b 



-00, 



as soon as rj > 1, under (CLfJJ) with a = 2 + 77. We deduce that 



■ (r) 



supcrcxp 



(4.86) 



(4.87) 



which achieves the proof of (OZj) . under (CLJTJ, (CLJ2J) and (CLSJ for a > 3. On 

the other hand, (-Fn )n>o is a locally square- integrable real martingale whose predictable 
quadratic variation is given by (F( r ^) = and, for aU n > 1, by 



°n-l- 



To prove (I4.83p . we will use Theorem 1 of [7]. For R large enough and all k > 1, we have 



p 



= p 



(R) 



> 



r 



Vi - vl 



(R) 



> — ) = 0. 

r 



This implies that 



J= k - X = -00. (4. 



lim sup — log ( n ess sup P [ (v k - V^ R A > b n y/n 

n^oo b n \ k>l \ ^ ' 

For all 7 > and all 5 > 0, we obtain from Lemma [4.81 and Remark 14.14 that 

1 / 1 " 2 N 

limsup-logP ("£(*&) I{|.v«,|>^} > ^ 



—00. 
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Finally, from Lemma I4.6[ Lemma 14.81 and Remark I4.1[ it follows that 

(F^ r ' R ^)n ^ Sn-l r\ ( ^l-l \ , r\ supcrcxp 

= Qr = —Qr + Qr — > Qr*- 

n n \ n n I n b\ 

where 

Q R = E 



and i is given by (14. 6p . Moreover, it is clear that Qr converges to as R goes to infinity. 
In light of foregoing, we infer from Theorem 1 of [7] that [Fn /(b n \/nj) satisfies an LDP 
on R of speed b 2 n and good rate function 

Ir{x) 



2Qd 

In particular, this implies that for all 5 > 0, 

^^{t^^)--^?- (4 ' 89) 

and letting R go to infinity clearly leads to the end of the proof of (I4.83p . We are able to con- 
clude now that (Mn / (b n y/n)) is an exponentially good approximation of (M n /(6 nA /n)). 
By application of Theorem 4.2.16 in [6], we find that (M n / \b n y/n)) satisfies an LDP on R 
with speed b\ and good rate function 

J[x) = sup liminf inf Jr(z), 

where Jr is given in (I4.8ip and B x j denotes the ball {z : \z — x\ < 5}. The identification 
of the rate function J = J, where J is given in (I4.75P is done easily, which concludes the 
proof of Lemma 14.91 □ 

Remark 4.2. If we suppose that (CLJT]) holds with a > 2, then the exponential Lindeberg's 
condition in Lemma \4-8\ is easier to establish. Indeed, using ^.8$ , it follows that 



2+r) 



n 7 k=l 1 ' k=l k=l 

for n large enough and rj > 0, leading to 

p(-F*2iI/.v , *\ > 6 ) <v(-Y\V k \^>-(r^ X l 
\ n/ t[ l |Xfc - ll>r ^/ )~ \ n t^i ^ V b. 

Lemma 4.10. Under (CLJTJ, (CLJ2J) and (CLJ3D, the sequence 

1 (M n 



b n \fn \N n 



n>l 

satisfies an LDP on R 2 with speed b\ and good rate function 

1 



J(x) = -^x'A^x (4.90) 

£0 



where A is given by (14.511) . 



MODERATE DEVIATIONS FOR THE DURBIN- WATSON STATISTIC 



23 



Proof. We follow the same approach as in the proof of Lemma 14.91 We shall consider the 
2-dimensional vector martingale (Z n ) n > defined in (I4.47p . In order to apply Theorem 14.71 
we introduce the following truncation of the martingale (Z n ) n >o, for r > and R > 0, 



MA 



where Mn' R ^ is given in (I4.76P and where Nn' R ^ is defined in the same manner, that is, for 
all n > 2, 

n 

N<r*> ^x&vi* (4.91) 

k=2 

with X ( n ] and V^ R) given by (I4.77p . The exponential convergence (I4.52p still holds, by 
virtue of Lemma T4.6[ which immediately implies hypothesis (I4.69p . On top of that, Lemma 
14.81 ensures that, for all r > 0, 



n 



superexp 



0, (4.92) 



justifying hypothesis (I4.7ip . Via Theorem 14. 7\ (Zn ,Wl /(b n y/nj) satisfies an LDP on IR 2 with 
speed b\ and good rate function Jr given by 

M*) = ^rx'A- l x. (4.93) 

Finally, it is straightforward to prove that (zt R) /(b n ^)) is an exponentially good ap- 
proximation of (Z n /(b n y/n)). By application of Theorem 4.2.16 in [6], we deduce that 
(Z n /(b n y/n)) satisfies an LDP on R 2 with speed b 2 n and good rate function given by 

J(x) = supliminf inf Jr(z), 
s>o R-^°° z£B XtS 

where Jr is given in (14. 93ft and B Xt s denotes the ball {z : \z — x\ < 5}. The identification of 
the rate function J = J is done easily, which concludes the proof of Lemma 14.101 □ 

Proofs of Theorem 13. 1L Theorem 13.21 and Theorem 13.31 The residuals appearing 
in the decompositions (14. 24 p . (I4.46P and (I4.56P still converge exponentially to zero under 
(CLfTJ), (CLJ2]) and (CLJ3]), with speed 6 2 , as it was already proved. Therefore, for a 
better readability, we may skip the most accessible parts of these proofs whose development 
merely consists in following the same lines as those in the proofs of Theorem 12.11 Theorem 
12.21 and Theorem 12.31 taking advantage of Lemma 14.91 and Lemma 14.101 and applying the 
contraction principle given e.g. in j6]. □ 

Acknowledgments. The authors thank Bernard Bercu and Arnaud Guillin for all their 
advices and suggestions during the preparation of this work. 
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